Analyzing Cognitive Demands of a Scientific Reasoning Test Using the Linear Logistic Test Model (LLTM)

The development and evaluation of valid assessments scientific reasoning are an integral part research in science education. In the present study, we used linear logistic test model (LLTM) to analyze how item features related text complexity presence visual representations influence overall difficulty established, multiple-choice, competencies assessment instrument. This study data from n = 243 pre-service teachers Australia, Canada, UK. findings revealed that increased and, total, contributed 32% variance difficulty. These suggest multiple-choice items contain following cognitive demands: encoding, processing, combining textually presented information different parts is both images. adds our knowledge which demands imposed upon by instruments whether these relevant for construct under investigation—in this case, competencies. discussed education literature.